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The invention relates to a process for time-managing the 
utilization of data detected in a data flow as well as to the device 
implementing the process. 

The invention finds a particularly advantageous application for 
5 time-managing the displaying of subtitles obtained from digital data 
detected in a data flow conveyed in particular but not exclusively according 
to the MPEG 2 System transport standard. 

In most cases, a data flow conveyed according to the MPEG 2 
System transport standard comprises a temporal reference signal 

10 commonly denoted PCR (the abbreviation PCR standing for "Program 
Clock Reference"). The reference signal PCR makes it possible to 
establish a timescale for the data contained in the flow. Moreover, the data 
flow also contains synchronization signals commonly denoted PTS (the 
abbreviation PTS standing for "Presentation Time Stamp"). A 

15 synchronization signal PTS is a signal making it possible to implement an 
action on some of the data conveyed by the flow. For the data 
corresponding to a subtitle, it may, for example, involve the action of 
displaying the subtitle in synchronism with the appearance of an image. 
The display PTS signal associated with a subtitle is conveyed in the 

20 header of the subtitle. Its value gives the instant at which the subtitle is to 
be displayed. < 

The subtitles generally consist of coded data. It is therefore 
necessary to decode them before displaying them. The expression coded 
data should be understood, for example, to mean compressed data which 

25 need to be decompressed before display. 

In the case where, for example, the instant at which a subtitle is 
to be displayed is very close to the instant at which this subtitle is detected 
in the flow, the displaying of a subtitle may have drawbacks. The 
expression "very close in time" should be understood to mean that the 

30 duration which separates the instant at which the subtitle is detected is of 
the same order of magnitude or less than the duration required for the 
decoding of the data which represent the subtitle. Under these conditions, 
the duration of display of the subtitle may be very short and, in the extreme 
case, the subtitle may be lost. 



Moreover, in other cases, the data flow conveyed according to 
the MPEG 2 System standard does not contain any subtitles display PTS 
signal. These cases correspond, for example, to simultaneous subtitling 
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where it is desired that the subtitles be displayed as soon as possible after 
having been detected and decoded. In these cases, when a short subtitle 
follows a long subtitle, the duration of display of the long subtitle may be 
less than the duration of display of the short subtitle. Thus, the possible 
5 duration of display AST1 is then equal to: 

AST1 = AT + DST2 - DST1 , where: 

AT is the interval of time separating the first subtitle ST1 and the 
subtitle ST2 which follows the subtitle ST1 , 

DST1 is the duration of decoding of the subtitle ST1, and 
10 DST2 is the duration of decoding of the subtitle ST2. 

For respectively long and short subtitles ST1 and ST2, the 
durations DST2 and DST1 are respectively short and long. It follows that 
the duration of display of the long subtitle ST1 is all the shorter as the 
subtitle ST2 is a short subtitle and the subtitle ST1 is a long subtitle. 

15 

The invention does not have these drawbacks. 
Thus, the invention relates to a device for time-managing the 
utilization of data detected in a data flow and constituting at least one data 
set, the device comprising a circuit for processing the data detected, a 

20 memory for storing the data detected, the data currently being processed, 
the processed data intended to be utilized and the processed data 
undergoing utilization, the utilization of the processed data having to be 
triggered at a given theoretical instant. The device comprises a circuit for 
calculating a minimum duration d of utilization of the data, which is 

25 proportional to the amount of data contained in the data set. 

The invention also relates to a process for time-managing the 
utilization of data detected in a data flow and constituting at least one data 
set, the process comprising a step of storing the detected data, a step of 

30 processing the stored data, a step of storing the data emanating from the 
processing step and a step of utilizing the stored data emanating from the 
processing step, the utilization of the processed data having to be triggered 
at a given theoretical instant. The process comprises a step of calculating 
a minimum duration d of utilization of the data, which is proportional to the 

35 amount of data contained in the data set. 

The invention finds a particularly advantageous application in 
the case where the set of data detected in the data flow represents a 
subtitle consisting of coded data, which subtitle is to be displayed on 
screen after decoding the data. The decoding of the data then constitutes 
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the processing of the data and the displaying of the data constitutes the 
utilization of the data. 

Thus, the invention also relates to a device such as that 
mentioned above according to the invention, characterized in that the 
5 detected data set represents a subtitle consisting of coded data detected in 
a flow of data conveyed according to the MPEG 2 System transport 
standard, not exclusively, and in that the processing circuit is a circuit for 
decoding the coded data, the utilization of the data being the displaying of 
the data on screen. 

1 0 The invention further relates to a decoder operating according to 

a compression standard of the MPEG 2 video type, characterized in that it 
comprises a device such as that mentioned above according to the 
invention. 

Likewise, the invention relates to a process such as that 
15 mentioned above, characterized in that the set of data detected in the data 
flow represents a subtitle consisting of coded data detected in a data flow 
conveyed according to the MPEG 2 System transport standard, in that the 
processing of the data is the decoding of the coded data and in that the 
utilization of the data is the displaying of the data on screen. 
20 The object of the invention is to guarantee a minimum duration 

d of utilization of a data set, which is proportional to the amount of data 
which this set contains. 

Once calculated, the minimum duration d is applied to a circuit 
for controlling the duration of utilization so that the duration of utilization of 
25 the data may not be less than d. 

Within the framework of the particular application of the 
invention to the displaying of subtitles, the minimum duration of display of 
the subtitle can be given by the data item D(ST) such that: 

30 D(ST) = K ST x L, L being the length of the subtitle and K ST a 

positive real number. 

The length L can be the cue relating to the length of the subtitle 
contained in the data flow. The length L can also be equal to the number of 
full lines of the decoded subtitle expressed in the form of a real number. 

35 Other data relating to the subtitle can also be used to calculate the data 
item D(ST). This may, for example, be a parameter m dependent on the 
complexity of the language in which the subtitle is to be displayed. In this 
case, a set of languages contained in a table (not described) are 
associated with weighting coefficients making it possible to vary the 




parameter m as a function of the language. The data item D(ST) is then 
written: 

D(ST) = K ST x L x m. 

Thus, the invention finds a particularly interesting application in 
5 respect of the broadcasting of one and the same program over a territory 
where various languages are used. 

According to an improvement of the invention, the minimum 
duration of utilization of the data is made compatible with constraints of 

10 synchronization, durations of processing of the data before utilization and 
random-access memory available for storing the data. 

The attached figure represents a device allowing the 
implementation of the improvement of the invention. By way of nonlimiting 
example, this improvement is described within the framework of the 

1 5 particular application of the displaying of subtitles. 

The device comprises two memory areas Z1 and Z2, a counter 
CNT and a microprocessor MP. 

The memory areas Z1 and Z2 are RAM-type random-access 
memory areas. The memory area Z1 is divided into several memory 

20 spaces BR1, BR2..., BRm which will hereinafter be referred to as reception 
buffers. Likewise, the memory area Z2 is divided into several memory 
spaces BV1 , BV2, ...Bvn which will hereinafter be referred to as display 
buffers. As is known to the person skilled in the art, a display buffer is a 
memory space capable of allowing the displaying on screen of the data 

25 which it contains. 

The data which represent the subtitles constitute a signal ST 
transmitted to the memory area Z1. According to the invention, the data 
which represent a subtitle are stored in a first reception buffer BR1 . If the 
processing of the data performed in the memory area Z2 has not 

30 terminated, then the data which represent the next subtitle are stored in 
another reception buffer BR2. The subtitles stored in the memory area Z1 
are transmitted to the memory area Z2 one after another so that a subtitle 
transmitted into the area Z2 is always the oldest one stored in the area Z1. 

According to the preferred embodiment of the invention, each 

35 buffer of the area Z2 is either in a state of decoding the data which it 
contains, or empty of any data, or in a state awaiting display, or in a state 
of display. The expression buffer in a "state awaiting display" should be 
understood to mean that the data contained in the buffer are intended to 
be read for display. The expression buffer in a "state of display" should be 




understood to mean that the data contained in the buffer are being read so 
as to be displayed on screen. 

According to another embodiment of the invention, the decoding 
of the data is not performed in a display buffer of the area Z2 but in a 
5 reception buffer of the area Z1 . It is then possible for the operation for 
decoding the data to be performed as and when they are received. 

Preferably, the memory area Z2 is divided into 5 display buffers 
each of which is able to be either in a state of decoding, or empty of data, 
or in a state awaiting display, or in a state of display. According to the 

10 preferred embodiment of the invention, one display buffer is permanently in 
a state of decoding and another in a state of display. It follows that the 
other 3 buffers are either empty of data, or in a state awaiting display. 
Generally, if n is the number of buffers which the area Z2 contains, then 
n-2 buffers are either empty of data, or awaiting display. 

15 Each time a buffer switches to the awaiting display state, a cue I 

is transmitted from the memory area Z2 to the microprocessor MP. In 
return, the microprocessor MP transmits a data item D to the counter CNT 
which makes it possible to increment the latter by one unit. The counter 
then transmits a data item E to the memory area Z2 which makes it 

20 possible to tag the buffer which has just switched to the awaiting display 
state. At the moment of display, the buffer in the display state is then 
identified as being that whose tag signals that it is the oldest. 

Generally, the duration d of display calculated by the 
25 microprocessor MP at an instant t may be written: 
d = D(ST) x X(t), where 

- D(ST) is the data item proportional to the subtitle length L, as 
defined previously, and 

-X(t) an increasing function of the size of an area of the memory 
30 Z2 or Z1 + Z2 empty of data. 

Advantageously, the minimum duration of display of a subtitle 
can thus be increased when the size of the memory area empty of data 
increases and decreased when the size of the memory area empty of data 
decreases. 

35 According to a particular embodiment of the improvement of the 

invention, the data item X(t) is calculated so as to tend to a data item X 0 
which may not be exceeded. It is then advantageously possible to avoid an 
accumulation of the delay in displaying the subtitles. 




According to the preferred embodiment of the invention, the 
data item X(t) is calculated according to an algorithm implementing 
calculations of the PID type (standing for Proportional/Integral/Differential). 

The equation which governs the proportional regime is given by 
5 the formula: 

Xp(t+At) = Kp x EM(t+At), where 

- Kp is a positive real number, and 

- EM(t+At) is a data item representing the size of a memory area 
empty of data at the instant t+At, the interval of time At being a duration 

10 representing the detection of two successive subtitles in the flow. By way 
of nonlimiting example, At can be equal to the average duration separating 
the detection of two successive subtitles, which is calculated on the basis 
of n previously detected subtitles, n being an integer number, for example 
equal to 10. 

15 The data item EM (t+At) can be equal either to the number N of 

display or reception buffers which are completely empty of data at the 
instant t+At, or to the number N of display or reception buffers which are 
completely empty of data at the instant t+At, plus, at this same instant, the 
memory space empty of data of the display or reception buffer in the 

20 decoding state. 

The equation which governs the integral regime is given by the 

formula: 

Xi(t+At) = Ki x I (t+At), where 

25 l(t+At) = l(t) - R, with l(t+At) such that -11 < l(t+At) < 12 (11 and 12 

positive) and R = T A - T R . 

The values 11 and 12 are chosen so as to limit the influence of 
the integral term Xi(t+At). T A is the instant at which the displaying of the 
subtitle actually begins and T R the theoretical instant at which the subtitle is 

30 to be displayed. The quantity R thus represents the algebraically calculated 
delay between the instant at which the displaying of the subtitle actually 
begins and the theoretical instant at which the subtitle is to be displayed. 

In the case where within the flow there is a PTS signal relating 
to the displaying of a subtitle, the instant T R is the value of the PTS. In the 

35 case where there is no PTS signal in the flow, the instant T R is a time 
reference whose value is such that, for example, the quantity T A -T F is equal 
to y% of the duration of decoding of the subtitle, T F being the instant at 
which the subtitle is detected in the flow. By way of nonlimiting example, y 
can be equal to 120. 




The minimum duration d of display of a subtitle grows by the 
quantity R if R is negative and diminishes by the quantity R if R is positive. 
The integral term Xi(t+At) thus allows advantageous management of the 
successive delays r. 

5 

The equation which governs the differential regime is given by 

the formula: 

Xd(t+At) = -Kd x (EM(t+At)-EM(t))/ At 

where Kd is a positive real number. 
10 The contribution of the differential term to the function X(t) 

advantageously makes it possible to take account of the rate at which the 
size of the memory area empty of data is changing. 

According to the preferred embodiment mentioned above, the 

15 duration of display d of a subtitle is calculated according to an algorithm 
implementing several PID type calculations. It follows that at the instant 
t+At the duration d is proportional to the quantity Xp,i,d(t+At) such that: 

Xp,i,d(t+At) = Xp(t+At) + Xi(t+At) + Xd(t+At) with Xmin< 
Xp,i,d(t+At)<X 0> where Xmin is, for example, a duration such that the 

20 duration d is substantially equal to 350 ms, below which duration a human 
eye is no longer aware of the showing of a subtitle on the screen. 

The invention also relates to other algorithms for calculating the 
duration d. These may, among others, be a proportional-type calculation 
algorithm (only the proportional term such as calculated above is then 

25 involved in the expression for X(t+At)), or alternatively a 
proportional/integral-type calculation algorithm (only the proportional and 
integral terms such as calculated above are then involved in the 
expression for X(t+At)). Generally, as mentioned previously, the algorithm 
for calculating the minimum duration d of display of a subtitle is an 

30 increasing function of a random access data memory area. The calculation 
algorithm according to the invention can be an algorithm implementing 
fuzzy logic. 

Once calculated, the minimum duration of display of a subtitle d 
is applied to a circuit (not represented in the figure) which controls the 
35 displaying of the subtitles data Dst emanating from the display buffer in the 
display state. The duration of display of the subtitle is then guaranteed to 
not be less than d. 



Of course, the invention is not limited to the embodiment 



described. 
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